Super Sparse Convolutional Neural Networks
نویسندگان
چکیده
منابع مشابه
Sparse Diffusion-Convolutional Neural Networks
The predictive power and overall computational efficiency of Diffusionconvolutional neural networks make them an attractive choice for node classification tasks. However, a naive dense-tensor-based implementation of DCNNs leads to O(N) memory complexity which is prohibitive for large graphs. In this paper, we introduce a simple method for thresholding input graphs that provably reduces memory r...
متن کاملSpatially-sparse convolutional neural networks
Convolutional neural networks (CNNs) perform well on problems such as handwriting recognition and image classification. However, the performance of the networks is often limited by budget and time constraints, particularly when trying to train deep networks. Motivated by the problem of online handwriting recognition, we developed a CNN for processing spatially-sparse inputs; a character drawn w...
متن کاملSparse 3D convolutional neural networks
We have implemented a convolutional neural network designed for processing sparse three-dimensional input data. The world we live in is three dimensional so there are a large number of potential applications including 3D object recognition and analysis of space-time objects. In the quest for efficiency, we experiment with CNNs on the 2D triangular-lattice and 3D tetrahedral-lattice. 1 Convoluti...
متن کاملEfficient Sparse-Winograd Convolutional Neural Networks
Convolutional Neural Networks (CNNs) are compute intensive which limits their application on mobile devices. Their energy is dominated by the number of multiplies needed to perform the convolutions. Winograd’s minimal filtering algorithm (Lavin (2015)) and network pruning (Han et al. (2015)) reduce the operation count. Unfortunately, these two methods cannot be combined — because applying the W...
متن کاملConvolutional Neural Networks Analyzed via Convolutional Sparse Coding
In recent years, deep learning and in particular convolutional neural networks (CNN) have led to some remarkable results in various fields. In this scheme, an input signal is convolved with learned filters and a non-linear point wise function is then applied on the response map. Oftentimes, an additional non-linear step, termed pooling, is applied on the outcome. The obtained result is then fed...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the AAAI Conference on Artificial Intelligence
سال: 2019
ISSN: 2374-3468,2159-5399
DOI: 10.1609/aaai.v33i01.33014440